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(57) Abstract: A method in a cellular mobile packet data network is provided composed of four main steps. These are capturing 
raw traffic traces over standardized interfaces of an operational cellular mobile data network, parsing through the traces in order to 
extract and correlate all the information, which is needed to build a traffic and session database, defining a set of appropriate key 
performance indicators, and calculating the above defined key performance indicators. A system in a mobile data network is also 
provided, the key element of which is a traffic and session database, which correlates traffic and mobility information extracted 
from passively captured traces collected from standardized interfaces. A set of key performance indicators describing the true, user 
perceived end-to-end quality of the most commonly used applications is also listed. 
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PERFORMANCE MANAGEMENT OF CELLULAR MOBILE PACKET DATA 

NETWORKS 



5 BACKGROUND OF THE INVENTION 

Technical Field of the Invention 

The invention relates to a performance management 
10 method and a system in a cellular mobile packet data network 
including but not limited to performance analysis, 
bottleneck analysis, system improvement and dimensioning. 

Description of Related Art 

15 

The performance management of cellular mobile data 
networks such as General Packet Radio Service (GPRS) , 
Universal Mobile Telecommunication Service (UMTS) and Code 
Division Multiple Access 2000 (CDMA200O), gets more and more 
2 0 important as the number of subscribers starts to pick up, 
the traffic on these networks increases and subscribers 
start to use more and more different applications and 
services. There is a need for performance management 
solutions, which makes it easy to find out when there is a 

2 5 performance problem in the network, but it has the same 

importance to find out the location of the performance 
problem. Such a performance management system should help 
the operator in the fields mentioned before, i.e. 
performance analysis indicates whether users get what they 

3 0 paid for or what they expect, bottleneck analysis presents 

what the bottlenecks are in the network, system improvement 
tries to enhance the system such that these problems get 
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eliminated after identifying the causes of performance 
problems, and dimensioning shows which cells, links, etc 
need to be re- dimensioned, and how. 



5 In case of a circuit switched service such as voice, it 

was basically enough to measure the call intensities, call 
durations and the ratio of blocked calls. In case of packet 
switched services e.g. Web, Wireless Application Protocol 
(WAP), File Transfer Protocol (FTP), e-mail, Multimedia 

10 Message Service (MMS) , etc. the above tasks are not at all 
trivial, because the end-to-end (or user perceived) 
performance depends on the interaction of many protocols at 
different interfaces and on various protocol layers. 
Furthermore, the use of shared resources leads to rather 

15 complicated queuing phenomena, which are difficult to model 
and analyze . 

In current GSM, GPRS, CDMA2 000 and UMTS networks, the 
service area is divided into cells covering limited 

2 0 geographical areas. The aim of the mobile operator should be 

to provide a constant and ubiquitous high quality service 
regardless of the location of its subscribers. This is a 
very challenging task for example because subscribers tend 
to be distributed non-homogenous ly across the service area. 

25 

Solutions are known for passive measurement based 
characterization of Internet Protocol (IP) e.g. in "A 
Passive Method for Estimating End- to- End TCP Packet Loss", 
IEEE Globecom 2002, as well as GPRS networks determining 

3 0 user perceived quality using passive monitoring in packet 

switched systems. For example, in case of GPRS packets on 
the so-called Gi interface have been captured. The Gi 
interface connects the Gateway GPRS Support Node (GGSN) with 
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external packet data networks e.g., an Internet Service 
Provider (ISP) . Based on the Gi traffic traces detailed 
traffic and end-to-end performance analysis results has been 
delivered to operators . At the same measurement point where 
5 Gi traffic can be captured, the messages to/from the Remote 
Authentication Dial-In User Service (RADIUS) server can 
typically also be captured. The RADIUS packets can be used 
to reconstruct user sessions. 



10 Performance counters for GSM/GPRS cells are known from 

the practice. E.g. Statistics and Traffic Measurement 
Subsystem (STS) in the Ericsson Base Station System (BSS) 
records some key radio network events. These counters 
provide information about the performance and traffic load 

15 in specific cells. The following list exemplifies what sort 
of information the operator can obtain from these counters: 

- The number of connections successfully established on 
the Traffic Channel (TCH) . 

- For every cell there are counters for the number of 

2 0 allocation attempts. They are incremented at every 

attempt to allocate a TCH in a resource type in the 
cell, to be used for signalling, data or speech, 
regardless of whether the allocation succeeded or 
failed. 

25 - A counter shows the accumulated number of available 

(i.e. idle and busy) Basic Physical Channels used for 
traffic in a cell. 

- Number of Offered Incoming Calls. 

- Number of Offered Normal Originating Calls. 

3 0 - A counter is stepped each time the Base Station 

Controller (BSC) attempts to allocate a set of one or 
more Packet Data Channels (PDCHs) from the circuit 
switched domain. 
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- Accumulated number of allocated PDCHs . 

- The peak number of active PDCHs from the last 15 
minutes . 

- The total number of Radio Link Control (RLC) data 

5 blocks transmitted by the Packet Control Unit (PCU) 

during the measurement period. 

- The total number of RLC data blocks retransmitted by 
the PCU during the measurement period. 

- Accumulated number of Temporary Block Flows (TBFs) per 
10 traffic combination of Upload/Download (UL/DL) . 

- Accumulated number of PDCHs carrying at least one TBF 
per traffic combination of UL/DL and GPRS/EGPRS, where 
EGPRS stands for Enhanced General Packet Radio Service. 



15 Counters are collected every 5 or 15 minutes. This is 

the Basic Recording Period, which can be set by command and 
is recommended to be 15 minutes. Measurement data for the 
Basic Recording Period is accessible in the database for two 
hours . 

20 

There is a widespread knowledge about drive tests. In 
this set-up, special purpose terminals are used, which run a 
given application. A test user operates the terminal and it 
runs an application, which is under test. 

2 5 In case of cellular mobile data networks, the terminal 

can for example be installed on the board of public 
transport service bus or a taxi . The application is run 
repeatedly, and the performance results together with the 
cell level location of the test are recorded. This way 

3 0 performance results are obtained for the cells, which have 

been visited during the drive test. 
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Early experiments quickly showed that in order to 
efficiently monitor and manage cellular mobile data 
networks, two type of information is necessary: User 
perceived end-to-end performance of different applications 
5 and information about the resource usage and performance in 
the different cells. The need for the first type of 
information is obvious, the reason for requiring this 
information on cell level is that cells are the basic 
dimensioning units of cellular data networks, congestion 
10 typically occurs because the resources of a particular cell 
are exhausted, and the performance problem can most often be 
alleviated by adding additional resources, e.g. a couple of 
new traffic channels to the problematic cell. 

15 As mentioned before, advanced passive measurement based 

methods are available to characterize the user perceived - K 
end-to-end performance of different applications in case of 
GPRS networks, but these methods currently work on a whole- 
network basis and it is not currently possible to obtain the 

2 0 key performance indicators on cell level. The problem with 

the monitoring systems developed for the Internet is that 
they miss an important abstraction level, which is key to a 
mobile operator, and that is the level of the mobile 
subscriber. IP addresses and IP application transactions 
25 need to be associated with the mobile subscriber they belong 
to, which cannot be done with a traditional IP network 
monitoring system. 

There is a set of counters available in the BSS of 

3 0 company Ericsson to obtain performance results on cell 

level. It is clear from the above list that these counters 
can be used to understand the cell level performance of 
circuit switched services but they do not tell much about 



5 



WO 2005/032186 PCT/SE2003/001517 

the user perceived end- to- end quality of service of packet 
switched applications and services. Other problem with the 
counters is that different system vendors might implement 
different counters, which makes it impossible to build a 
5 coherent performance monitoring system in a multi-vendor 

network. Furthermore, the maintenance of these counters puts 
a significant load on the BSC node. Therefore performance 
results are available only with a very coarse-grained time 
resolution. The most important problem with the third 

10 performance-monitoring alternative, the drive test is that 
it is not scalable. It generates additional load over the 
network and it requires significant time to cover a large 
area with enough measurements to allow obtaining 
statistically reliable measurement results, not to mention 

15 the difficulty of generating realistic application level 
traffic patterns in such an artificial use case. 

Thus there is a particular need for a passive 
performance monitoring solution, which provides information : 
2 0 about the true, user perceived end-to-end performance of 

mobile data networks; it provides this information on cell 
level; it is scalable; and it is vendor independent. 



To build such a passive performance monitoring system 
25 for cellular data networks is not trivial because the 

information, which is necessary to be collected, cannot be 
obtained at a single measurement point. 



SUMMARY OF THE INVENTION 

3 0 The present invention provides a method in a cellular 

mobile packet data network composed of four main steps. 
These are capturing raw traffic traces over standardized 
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interfaces of an operational cellular mobile data network; 
parsing through the traces in order to extract and correlate 
all the information, which is needed to build a traffic and 
session database. This database contains information about 
5 each and every user session and user transaction, which 
happened during the measurement period; defining a set of 
appropriate key performance indicators, which can be used to 
characterize the performance of cells in terms of user 
perceived quality of service parameters; and calculating the 
10 above defined key performance indicators by selecting an 
appropriate subset of the transactions in the traffic 
database, and calculating the key performance indicator 
value by summing /averaging the given Quality of Service 
(QoS) measure of the selected individual transactions. 

15 

It is particularly an object of the invention to set up 
a system in a mobile data network, the key element of which 
is a traffic and session database, which correlates traffic 
and mobility information extracted from passively captured 
20 traces collected from multiple standardized interfaces. 



Accordingly, it is an object of the invention to enable 
efficient and detailed characterization and performance 
management of particular cells in a cellular mobile data 
2 5 network. A set of key performance indicators, which describe 
the true, user perceived end-to-end quality of the most 
commonly used applications are also listed. 



Another aspect of the invention is a computer program 
3 0 product for performance management in a cellular mobile 

packet data network performing the main steps of capturing 
raw traffic traces, building a traffic and session database, 
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defining a set of appropriate key performance indicators and 
calculating the key performance indicators . 

Such a method greatly improves the performance and 
5 service management of cellular mobile data networks, given 
that the operator can easily find out if the performance of 
a cell does not meet the user's expectations and can 
immediately act where the problem is. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

In the following, the essential features of the 
invention will be described firstly in general for any 
cellular mobile packet data network then in details by 
showing the diagrams and flowcharts of some preferred 
15 embodiments of GPRS network with reference to the figures of 
the attached drawings . 

Figure 1 is a flowchart showing the building of the 
traffic an session database in general. 

2 0 Figure 2 is a diagram of an exemplary architecture of a 

GPRS cellular mobile packet data network. 

Figure 3 is a flowchart illustrating the building of the 
GPRS traffic an session database from a Gb trace. 

Figure 4 is a flowchart depicting the building of the 
25 GPRS traffic and session database from an encrypted Gb and a 
Gr trace. 

Figure 5 is a flowchart showing the building of the 
traffic and session database from an encrypted Gb and Gn 
trace . 

3 0 Figure 6 is a flowchart illustrating the building of the 

traffic and session database from an encrypted Gb, a Gi, a 
RADIUS trace and an {MSISDN, IMSI} list. 
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Figure 7 is a flowchart depicting the building of the 
traffic and session database from an encrypted Gb, a Gi , a 
RADIUS trace and a fractional Gn trace . 

5 DETAILED DESCRIPTION OF THE INVENTION 

The first main step is to look at the architecture of 
the cellular mobile packet data network which has a 
plurality of mobile stations linked to a plurality of base 
stations through a plurality of radio channels, where the 

10 base stations are linked to a radio access network, and the 
radio access network is linked to a support node in a packet 
core network. We also have to look at the protocol stacks 
over the standardized interfaces. The result of this 
investigation is a set of interfaces, which need to be 

15 captured in order to have all the information necessary for 
the traffic and session database available. All the IP 
packets of all (or at least a significant portion to ensure 
statistical reliability of the results) of the user 
transactions need to be captured together with the session 

20 and mobility management signaling of the users. If the above 
information needs to be captured at multiple interfaces, it 
is required to have at least one unambiguous identifier of 
the user present in all the traces. An additional 
requirement is to record a times tamp with each captured 

2 5 packet. 

The second main step is to parse through the traces and 
to build the traffic and session database. The process is 
depicted in Figure 1. IP packets 115 from the captured 

3 0 traces 114 are processed one by one and the packets 

belonging to the same application transaction of the same 
user are grouped together in step 116. These groups can be 
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created by looking at the <source IP address, destination IP 
address, source port, destination port> fields in the IP 
header and by looking up the {Subs Id, IP address} 
association 119 in the User Sessions with Mobility Database 
5 106. Looking for the standard port numbers can identify 

applications, e.g.: Transmission Control Protocol (TCP) port 
80 for Web traffic. Depending on the application logic, 
identified packet groups can be further divided into user 
transactions like TCP connections, Hypertext Transfer 

10 Protocol (HTTP) object downloads, WAP object downloads, and 
so on. After having all packets of a particular transaction 
collected, condensed information like the start, end, 
duration, amount of data in uplink and downlink, success, 
failure of the transaction is generated and the information 

15 is stored 117 in a Transaction with Location Database 118 . 

Further difficulty is to associate subscribers with the 
condensed application transactions information collected 
above. In mobile packet data networks there are signaling 
messages 101 to initiate a subscriber data session. In these 

2 0 signaling exchanges 102, a subscriber identifies itself by 

one of its unique identifier in the mobile system, for 
example its International Mobile Subscriber Identity (IMS I) 
and the system answers with an IP address, which the mobile 
can use for its application transactions. By parsing through 
25 these signaling messages in step 103, the required 

association between subscribers and their transactions can 
be established. The QoS parameters requested for the 
subscriber data session can also be extracted from the 
signaling messages. 

3 0 The only missing link now is the association between 

the user transaction and its cell level location. In mobile 
data networks, typically when there is an active user data 
session and typically at interfaces in the radio access 
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network of the system, there is signaling 107 when the 
mobile changes cell. In these signaling messages 108 an 
identifier of the subscriber is sent together with its new 
cell level location 112 . The identifier is sometimes 
5 temporary but unique. If the identifier in these signaling 
exchanges is temporary, then the signaling exchange in which 
the subscriber identified with a permanent unique identifier 
gets its temporary unique identifier needs also to be 
interpreted in step 109. This results in a database 111 

10 containing the permanently unique identifier of the 

subscriber together with cells it visited, and the timestamp 
when the visit happened 110. Using this data, the condensed 
transaction information 118 is extended in step 112 with the 
cell level location of the transaction and an indicator of 

15 cell change during the course of the transaction. Finally, 
summary data 113, i.e. type and number of transactions, 
total number of uplink and downlink traffic, QoS profile, 
are generated about the transactions belonging into the same 
user session, and it is stored 104 together with the list of 

2 0 cells visited during the session and the timestamp of the 
visits resulting in a User Session with Mobility Database 
106. 



The third main step is defining the Key Performance 
25 Indicators (KPIs) . The following KPIs are used to 

characterize the performance of a cell in mobile packet data 
networks : 



MMS large message download/send rate in a specified cell 
3 0 Given in bit /sec, these KPIs define the average 

transmission rate during sending or downloading of large MMS 
messages. Only successful transactions are considered whose 
size is larger than a given amount of bytes. Recommended 
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value is 5 kbytes. The rate is calculated as the total IP- 
layer transmitted/received bytes divided by the total 
duration of the transaction. A size limit is included to 
eliminate transient effects of short messages. 

5 

WAP object download delay in a specified cell 

The average delay between the request packet from the 
mobile until the server response is successfully 
acknowledged by the mobile. Precondition: successfully 
10 finished download. 



Web small object download time (9-llkbyte) in a specified 
cell 

The average time it takes to download a small HTTP 
15 object. Only small (9-11 Kbytes) files are measured. Due to 
the TCP protocol, small objects are not able to utilize the 
full capacity available in the cell. The download time of . 
such small objects depends more on the round- trip time- To 
have comparable results between different measurements and 
2 0 cells, only objects that fall into a narrow range are 

measured. The chosen range of 9-11 kbytes was chosen because 
the median of Web downloads falls in this range. Condition: 
object download was successful. 



2 5 Web large object download rate (larger than SOkbyte) in a 

specified cell 

The average rate is the size of the object divided by 
the time it takes to successfully download the object. This 
measure is also called goodput. Only large objects are 

3 0 measured, when the available end-to-end path capacity 

dominates the measure and not the object size. Condition: 
object download was successful. 
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FTP download rate (larger than SOkbyte in a specified cell) 



The average rate is the size of the downloaded file 
divided by the time it takes to download it. Only large 
files are measured, when the available end-to-end path 
5 capacity dominates the measure and not the file size. 
Condition: file download was successful. 

P0P3, mail download time (9-llkbyte) in a specified cell 
This KPI defines the average time to successfully 

10 download one or more e-mails from the Post Office Protocol 3 
(POP3) e-mail server. The whole time is measured including 
server greeting, authentication, and time to download of all 
mails and quit. Condition: mail download was successful, and 
the total downloaded amount of bytes is small (between 9- 

15 llkbytes) . 

. P0P3, mail download rate (larger than SOkbyte) in a 
specified cell 

This KPI defines the average rate during successful 

2 0 download of one or more e-mails from the P0P3 e-mail server. 

The rate is measured during the whole time including server 
greeting, authentication, and time to download of all mails 
and quit. Condition: mail download was successful, and more 
than SOkbytes was downloaded. 

25 

End-to-end achievable throughput in a specified cell 

This KPI measures the achievable IP layer throughput 
end-to-end. This KPI is measured by tracing those mobiles 
that generate one or more parallel TCP downloads saturating 

3 0 the downlink channel. In an optimally configured network 

this KPI shows the available data transfer capacity in the 
cell. The KPI is calculated as follows: The total inbound 
traffic of the user (including other transactions) between 
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the first data packet of the particular TCP connection and 
the acknowledgement of the last data packet of the 
particular TCP connection. The above bytecount is divided by 
the time elapsed between the first and last inbound data 
5 packet . 

Rate of TCP Connections, Stalled Periods in a specified cell 

This KPI gives the average rate achieved by greedy TCP 
flows, as well as the frequency of stalled periods within 
10 them. 

User-Perceived Throughput History in a specified cell 

This KPI gives the throughput limitation users perceive 
as a function of time. It can be used for Service Level 
15 Agreement validation. It is based on the throughput of 

greedy user session segments. Optionally, the variance and 
quantiles can also be given. 

In addition to these values, it is necessary to 
determine the share of different traf fic ' types in the cells. 

2 0 This means calculating the accumulated traffic of the 

following protocols: TCP, User Datagram Protocol (UDP) , 
Internet Control Message Protocol (ICMP) , HTTP, FTP, WAP, 
Simple Mail Transfer Protocol (SMTP) , Domain Name System 
(DNS), POP3, Interactive Mail Access Protocol 4 (IMAP4) , and 
25 Telnet. 

By using the information captured in step building the 
traffic database, additional key performance indicators can 
be defined. 

3 0 The fourth main step is calculating the Key Performance 

Indicators. The procedure for calculating the above listed 
key performance indicators is as follows: 
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(1) Read the next transaction record from the traffic 
database . 

(2) Check whether this transaction is of the type, which the 
KPI is about. This can be done using the flow type field 

5 of the transaction record. 

(3) Check whether the transaction happened in the cell 
specified for the KPI. This can be done using the Cell 
Id field of the transaction record. 

(4) Calculate the quantity defined by the KPI for the 

10 particular transaction. Information elements used are: 

duration, times tamp of the first data packet, timestamp 
of the last data packet, packet count and loss count 
fields of the transaction record. 

(5) Add the value to an aggregation counter, and increase 
15 the counter calculating the number of eligible 

transactions for the KPI . 

(6) Go back to the beginning until all the transactions are 
processed. 

(7) Calculate the KPI value by dividing the value of the 
2 0 aggregation counter with count of the eligible 

transactions . 



In the following, some preferred embodiments will be 
2 5 described in GPRS networks. 

In the specific case of GPRS networks, shown in Figure 
2, mobile stations 2 01 communicate with base stations 2 02 
through radio channels. The base stations 202 are grouped to 
30 Base Stat ion Subsystems (BSSs) 2 03, which are connected to a 
SGSN 207. The SGSN 207 is linked to a packet core network 
209 and to a GGSN 210. The GGSN 210 is linked to a corporate 
network 212 and to an ISP network 213. Additionally, two WAP 
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Gateways 214 are connected to the ISP network 213. 
Measurement points 215, 217 are attached to monitors 216 
thereby accessing session and traffic information from the 
network. The session management information in GPRS network 
5 is communicated between the mobile stations 2 01 and the core 
network 2 09 (i.e., the GPRS network containing the SGSNs and 
GGSNs) . Depending on the configuration of the particular 
network, simultaneously captured traffic traces are needed 
for the method to operate from one or more of the interfaces 
10 listed below. Processing details in case of different trace 
combinations can be seen later in description of building 
the database . 

Gb interface 206, which interconnects the BSS 203 with 
the Serving GPRS Support Node (SGSN) 2 07, carries GPRS 
15 Mobility Management and GPRS Session Management signaling 
together with the data packets of the users. It is a Frame 
Relay interface, but many protocol analyzers (Nettest, 
Radcom, Nethawk, Tektronix) are available on the market to 
capture all traffic from one or more Gb interfaces 2 06 into 
2 0 a dump file. 

Gn interface 2 08 interconnects the GPRS Support Nodes 
i.e. the SGSNs 2 07 and GGSNs 210. It carries GPRS Session 
Management signaling together with user data packets. Both 
data and signaling packets are transported over GPRS 

2 5 Tunneling Protocol (GTP) . This interface is typically a 

standard IP (Ethernet) interface so freeware tools like 
TCPDump can be used to capture traffic from the Gn interface 
208 into a dump file. 

Gi interface 211 interconnects the GGSN 210 of the GPRS 

3 0 network with an external IP network, e.g. with corporate 

network 212 or ISP network 213. This interface is typically 
a standard IP (Ethernet) interface so freeware tools like 
TCPDump can be used to capture traffic from the Gi interface 
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211 into a dump file. In order to be able to track Packet 
Data Protocol (PDP) sessions on the Gi interface 211, RADIUS 
messages are also need to be captured in addition to the 
user data packets . 
5 Gr interface 218 interconnects the SGSN 2 07 with the 

Home Location Register (HLR) 219. Many protocol analyzers 
(Nettest, Radcom, Nethawk, Tektronix) are available on the 
market to capture traffic from Gr interfaces 218 into a dump 
file . 

10 

Figure 3 illustrates the building of the GPRS Traffic 
Database from a Gb Trace 3 05 showing the relationship 
between the different information elements available in the 
Gb trace 3 05, the required processing steps and the 
15 resulting databases 

The following information can be extracted from 
protocol data units captured over the Gb interface [General 
Packet Radio Service (GPRS) ; BSS-Serving GPRS Support Node 
(SGSN) ; BSS GPRS Protocol (BSSGP) (GSM. 08. 18 version 8.9.0 
20 Release 1999) ] 

Cell ID of each and every active user: BSS GPRS 
Protocol (BSSGP) 3 06 UPLINK- UNI TDATA 3 08 Protocol Data Unit 
(PDU) transfers a Mobile Station (MS) ' s Logical Link Control 
(LLC) -PDU and its associated radio interface information 

2 5 across the Gb interface. Part of this PDU is the Cell ID. 

GPRS Multi Slot Class: The purpose of the Mobile 
Station Classmark 4 information element (IE) is to provide 
the network with information concerning aspects of the 
mobile station related to GPRS . Among many other things this 

3 0 IE contains data about the GPRS Multi Slot Class. Mobile 

Station Classmark 4 IE is present in "Attach Request" 
messages. Another information element MS Radio Access 
Capability also contains the GPRS multiclass information. 



17 



WO 2005/032186 PCT/SE2003/001517 

This information element is present in BSSGP DOWNLINK- 
UNITDATA 3 09 . 

BSSGP DOWNLINK UNITDATA 3 08 PDU contains IMSI and MS 
Radio Access Capability, together with the Temporary Logical 
5 Link Identity (TLLI) , and the old TLLI whenever TLLI 

changes. BSSGP UPLINK UNITDATA 308 PDU carries the TLLI and 
. the Cell ID 310. The following algorithm 311 can be used to 
extract the mobility data: 

10 (1) Whenever a DOWNLINK UNITDATA 3 09 PDU is encountered in 
the trace, check whether it contains a new IMSI 312. 

If a new IMSI is encountered register it, together with 
the corresponding TLLI and timestamp. 
15 If an already known IMSI is encountered, check whether 

TLLI change is indicated. 

If TLLI change is indicated, register the new TLLI as 
. belonging to the old IMSI. 

20 (2) Whenever a BSSGP UPLINK UNITDATA 308 PDU is encountered 
in the trace, look up the IMSI database mentioned above 
to find out the IMSI which the TLLI belongs to 310. 
(3) Check whether the Cell ID is identical to the last one 
registered to the IMSI in the database. 

25 

If a new Cell ID is found, register it in step 313 to 
the IMSI together with the timestamp of the BSSGP PDU in the 
Mobility Database for IMS Is 315. 

3 0 Whenever an IP packet carrying user data is found in the 
BSSGP packet, it is used for reconstructing the user 
transactions in step 320. A transaction is coherent traffic 
between two endpoints, identified by IP address and ports 
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(only for TCP and UDP) . The delimitation of transactions is 
protocol-specific, for example, it is a connection in case 
of TCP, it is a request /response pair in case of a DNS 
query. Whenever packets of a new transaction are collected 
5 from the packet stream, a new record is created 321 in the 
Transactions with Location Database 322 containing the 
following information : 

- The timestamp of transaction start; 

- Flow type, Inner and outer addresses in step 318; Inner 
10 and outer ports; 

- Protocol number; 

~ Numeric identifier of the user session in step 318; 

- Transaction duration in seconds from start to last 

activity; 

15 - Number of packets in and out; Number of bytes in and 

out ; 

- IP layer rates in both directions (bits per second) ; 

- Protocol-dependent statistics. 

- IMSI of the user in step 318; 

20 - Cell Id at the start of the transaction in step 317, 

- Flag whether the user has changed cell during the 

transaction 

- MS Class of the terminal; 

25 Parallel with above described processing of the BSSGP header 
3 07 and user IP packets 319, the PDP session management 
signaling 3 01 contained in the BSSGP packets is also 
processed. Based on the "Create PDP Context Request", 
"Create PDP Context Response" signaling messages and the 

3 0 condensed transaction records, PDP session records are 
created in step 3 02 which store in step 3 03 in the PDP 
Session with Mobility Database 3 04 the following information 
about the new PDP session: 
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Starting times tamp; addresses and port numbers ; 
Numeric identifier referenced from the user 
transactions database ; 
5 - Duration; Number of transactions involved; 

- Number of packets and bytes transmitted for both 
directions ; 

Number of transactions on different network and 
application protocols in step 316. 
10 - IMSI of the user 

IP address allocated for the session 
QoS profile 

List of {Cellld, Timestamp} pairs tracking the 
mobility of the user during the session in step 314. 

15 

In Figure 4 the process of building the GPRS traffic 
database from an encrypted Gb 401 and a Gr trace 405 is 
outlined. Operators often encrypt their Gb interface, which 
hide the data and session management signalling above the 

2 0 LLC protocol layer. The solution in this case is to capture 
simultaneous trace over the Gr interface, look up the user 
specific Kc encryption key 404 in the Gr trace 405 and use 
the standardised encryption algorithms to decrypt 403 the Gb 
packets 402 [Digital cellular telecommunications system 

25 (Phase 2+) ; Security related network functions (GSM 03.20 

version 8.0.0 Release 1999)]. After decryption, the process 
is identical to the one described in Figure 3 . 

Figure 5 depicts the process of building the traffic 
30 database from an encrypted Gb 401 and a Gn trace 501. If the 
Gb trace is encrypted, it is encrypted at the LLC layer. 
This means that mobility management information can still be 
obtained from the BSSGP protocol header. The PDP session 
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control signalling messages are present in the Gn trace 5 01 
together with all the user data packets. IP packets 319 of 
the user data are extracted from the GTP tunnelling packets, 
and not from the BSSGP UNITDATA packets. 

5 

Figure 6 illustrates the process of building the 
traffic database from an encrypted Gb trace401, a Gi trace 
602, a RADIUS trace 601 and an {MSISDN, IMSI} list 603. It is 

10 possible to use Gi traces 602 provided that the Gi trace is 
amended with the RADIUS packets [General Packet Radio 
Service (GPRS) ; Interworking between the Public Land Mobile 
Network (PLMN) supporting GPRS and Packet Data Networks 
(PDN) (3GPP TS 09.61 Version^ 7 . 10 . 0 Release 1998)] (No 

15 optional IMSI in RADIUS packets I ) , and there is a database 
containing the list of { IMSI ,MSISDN} pairings 603 for the 
users. A RADIUS request will indicate the ( start of a PDP 
session and trigger the construction of a| new session 
record. The user will be identified in the RADIUS packets by 

2 0 an MSISDN. To be able to associate the mobility pattern 
found in the Gb trace with the user sessions and 
transactions the corresponding IMSI needs to be looked up 
604 in the {IMSI, MSISDN} database. 

2 5 A similar process of building the traffic database from 

an encrypted Gb, a Gi and RADIUS trace can be carried out 
according to the figure when the {MSISDN, IMSI} list is 
missed but the vendor specific parameter IMSI is present in 
the RADIUS messages. A RADIUS request will indicate the 

3 0 start of a PDP session and trigger the construction of a new 

session record. The user will be identified in the RADIUS 
packets by the IMSI therefore the mobility pattern found in 
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the Gb trace can be associated with the user sessions and 
transactions found in the Gi /RADIUS trace. 



5 Figure 7 shows the process of building the traffic 

database from an encrypted Gb trace 401, a Gi trace 602, a 
RADIUS trace 601 and a fractional Gn trace 701. If there is 
any sort of Gn trace available, not necessarily simultaneous 
with the Gb and Gi trace, but covering the same network 

10 segment, it can be used to automatically build a large 
enough database of {IMS I, MSISDN} pairs: 

If GTP version used over the Gn interface is vO , the 
IMSI is contained in every message header as part of the 
Tunnel ID field, while the MSISDN is present as a mandatory 

15 parameter in "Create PDP Context Request" messages in step 
702 . 

If GTP version used over the Gn interface is vl, both 
■ the IMSI and the MSISDN is contained as a conditional 
parameter in "Create PDP Context Request" messages in step 
20 702. 

Using this list of {IMSI, MSISDN} pairs 603, the procedure 
of the previous section can be applied. 

2 5 The key performance indicators listed before are 

suitable for the specific case of GPRS networks. The process 
described before can be used for calculating the key 
performance indicators from the GPRS traffic databases. 

30 

The method for passive measurement based 
characterization of mobile packet data networks makes 
possible for the operator to obtain key performance 
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indicators to describe the user perceived end-to-end 
performance of different applications, and the measurement 
results are associated with specific cells. The method 
therefore not just indicates a performance problem but also 
5 pinpoints the location of the problem. It uses raw 
measurement data available from standardized network 
interfaces, which has two important advantages: it is vendor 
independent and easy to obtain enough measurement data to 
calculate results with statistical significance. 

10 Cellular mobile packet data operators when trying to 

increase the revenue they obtain from packet switched 
services face a significant challenge. They need to attract 
business users to cash in a big amount of money, but 
business users require a robust, reliable service, which 

15 offers quality of service guarantees. One way to overcome 
this problem is to define a service level agreement, which 
outlines what sort of guarantees the subscriber can expect 
from the network. For such an agreement to be convincing for 
the potential customers, it shall be written in terms of . the 

20 user perceived performance indicators. The monitoring method 
described in this invention is a tool for the operator to 
offer such new, value added services, because it gives a 
cheap, easy to implement way of monitoring and tracking the 
guarantees put forward in such a service level agreement. 

2 5 Further advantage of the method is that it does not 

rely on a particular trace when constructing the traffic 
database but it is capable of obtaining and correlating the 
required information from a set of different trace 
combinations of standardized Gb, Gi , Gn, and Gr GPRS 

30 interfaces. This makes the method applicable for most of 
GPRS networks which are run today regardless of their 
salient configuration settings. 
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Although, only preferred embodiments of GPRS network 
have been illustrated in the accompanying Drawings and 
described in the foregoing Detailed Description, it is 
understood that the invention is not limited to the 
embodiments disclosed, but is capable of arrangements, 
modifications, and substitutions of other mobile data 
networks without departing from the spirit of the invention 
as set forth and defined by the following claims. 
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1 . A method for performance management in a cellular 
mobile packet data network having a plurality of mobile 
stations linked to a plurality of base stations through a 
plurality of radio channels, the base stations being linked 
to a radio access network, and the radio access network 
being linked to a support node in a packet core network 
comprising the steps of 

capturing raw traffic traces over standardized 
interfaces of the operational cellular mobile data network; 

building a traffic and session database by parsing 
through the traces in order to extract and correlate all the 
information which is needed to the database; 

defining a set of appropriate key performance 
indicators, which can be used to characterize the 
performance of cells in terms of user perceived quality of 
service parameters; and 

calculating the above defined key performance 
indicators . 

2 . The method for performance management of claim 1 , 
wherein the cellular mobile packet data network is a GPRS 
network. 

3. The method of claim 2, wherein the step of capturing 
raw traffic traces over standardized interfaces of the 
operational cellular mobile data network relates to Gb 
trace . 

4. The method of claim 2, wherein the step of capturing raw 
traffic traces over standardized interfaces of the 
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operational cellular mobile data network relates to an 
encrypted Gb and Gr trace. 



5. The method of claim 2, wherein the step of capturing raw 
traffic traces over standardized interfaces of the 
operational cellular mobile data network relates to an 
encrypted Gb and a Gn trace. 

6. The method of claim 2, wherein the step of capturing raw 
traffic traces over standardized interfaces of the 
operational cellular mobile data network relates to a Gk>, a 
Gi and a RADIUS trace. 

7. The method of claim 2, wherein the step of capturing raw 
traffic traces over standardized interfaces of the 
operational cellular mobile data network relates to an 
encrypted Gb, Gi , RADIUS trace and an {MSISDN, IMSI} list:. 

8. The method of claim* 2, wherein the step of capturing raw- 
traffic traces over standardized interfaces of the 
operational cellular mobile data network relates to an 
encrypted Gb, Gi , RADIUS trace and a fractional Gn trace. 

9. The method of claim 1, wherein the step of building* a 
traffic and session database the database contains 
information about each and every user session and user 
transaction which happened during the measurement period.. 

10. The method of claim 1, wherein the step of defining- a 
set of appropriate key performance indicators comprises a 
key performance indicator measuring MMS large message 
download/send rate in a specified cell. 



26 



WO 2005/032186 PCT/SE2003/001517 

11. The method of claim 1, wherein the step of defining a 
set of appropriate key performance indicators comprises a 
key performance indicator measuring WAP object download 
delay in a specified cell 

5 

12. The method of claim 1, wherein the step of defining a 
set of appropriate key performance indicators comprises a 
key performance indicator measuring Web small object 
download time in a specified cell, where the size of a small 

10 object is about 9-11 kbyte. 



13. The method of claim 1, wherein the step of defining a 
set of appropriate key performance indicators comprises a 
key performance indicator measuring Web large object 

15 download rate in a specified cell, where the size of a large 
object is larger than 5 0kbyte. 

14. The method of claim 1, wherein the step of defining a 
set of appropriate key performance indicators comprises a 

2 0 key performance indicator measuring FTP download rate in a 
specified cell, where the size of the downloaded file is 
larger than SOkbyte. 

15. The method of claim 1, wherein the step of defining a 
25 set of appropriate key performance indicators comprises a 

key performance indicator measuring P0P3 , mail down, load time 
in a specified cell, where the size of the downloaded file 
is about 9-llkbyte. 

30 16. The method of claim 1, wherein the step of defining a 
set of appropriate key performance indicators comprises a 
key performance indicator measuring P0P3 , mail download rate 
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in a specified cell, where the size of downloaded file is 
larger than 5 0kbyte. 

17. The method of claim 1, wherein the step of defining a 
set of appropriate key performance indicators comprises a 
key performance indicator measuring end-to-end achievable 
throughput in a specified cell. 



18. The method of claim 17, wherein the calculation of key 
performance indicator measuring end-to-end achievable 
throughput in a specified cell comprises the steps of: 

calculating the total inbound traffic of the user, 
including other transactions, between the first data packet 
of the particular TCP connection and the acknowledgement of 
the last data packet of the particular TCP connection; 

dividing the above bytecount by the time elapsed 
between the first and last inbound data packet. 

19. The method of claim 1, wherein the step of defining a 
set of appropriate key performance indicators comprises a 
key performance indicator measuring the rate of TCP 
connections and stalled periods in a specified cell. 

20. The method of claim 1, wherein the step of defining a 
set of appropriate key performance indicators comprises a 
key performance indicator measuring the user-perceived 
throughput history in a specified cell. 

21. The method of claim 1, wherein the step of calculating 
the performance indicators is carried out by selecting an 
appropriate subset of the transactions in the traffic 
database . 
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22. The method of claim 1, wherein the step of calculating 
the performance indicators is carried out by calculating the 
key performance indicator value by summing the given Quality 
of Service measure of the selected individual transactions. 

23. The method of claim 1, wherein the step of calculating 
the performance indicators is carried out by calculating the 
key performance indicator value by averaging the given 
Quality of Service measure of the selected individual 
transactions . 

24. The method of claim 1, wherein the step of calculating 
the performance indicators contains the steps of 

reading the next transaction record from the traffic 
and session database; 

checking whether this transaction d_s of the type, which 
the KPI is about; 

checking whether the transaction happened in the cell 
specified for the KPI; 

calculating the quantity defined by the KPI for the 
particular transaction ; 

adding the value to an aggregation counter, and 
increase the counter calculating the number of eligible 
transactions for the KPI; 

returning to the beginning until all the transactions 
are processed; 

calculating the KPI value by dividing the value of the 
aggregation counter with count of the eligible transactions. 

25. The method of claim 24, wherein the step of checking 
whether this transaction is of the type, which the KPI is 
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about is carried out by using the flow type field of the 
transaction record. 

26. The method of claim 24, wherein the step of checking 
whether the transaction happened in the cell specified for 
the KPI is carried out by using the Cell Id field of the 
transaction record. 

27. The method of claim 24, wherein the step of calculating 
the quantity defined by the KPI for the particular 
transaction uses the information elements of duration, 
times tamp of the first data packet, timestamp of the last 
data packet, packet count and loss count fields of the 
transaction record. 

28. A system for performance management in a cellular mobile 
packet data network having a plurality of mobile stations 
linked to a plurality of base stations through a plurality 

of radio channels, the base stations being linked to a radio 
access network, and the radio access network being linked to 
a support node in a packet core network, a monitor node 
residing on a computer coupled to the network comprising: 

means for capturing raw traffic traces over 
standardized interfaces of the operational cellular mobile 
data network; 

means for building a traffic and session database by 
parsing through the traces in order to extract and correlate 
all the information which is needed to the database; 

means for defining a set of appropriate key performance 
indicators, which can be used to characterize the 
performance of cells in terms of user perceived quality of 
service parameters; and 
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means for calculating the above defined key performance 
indicators . 

29. The system of claim 28, in which monitor node comprising 
a traffic and session database which correlates traffic and 
mobility information extracted from passively captured 
traces collected from standardized interfaces. 



30. A computer program product for performance management in 
10 a cellular mobile packet data network including a monitor 

node, comprising a computer readable storage medium having 

computer readable program code embodied in said medium, said 

computer-readable program code comprising: 

computer-readable program code that captures raw 
15 traffic traces over standardized interfaces of the 

operational cellular mobile data network; 

computer-readable program code that builds a traffic 

and session database by parsing through the traces in order 

to extract and correlate all the information which is needed 
2 0 to the database; 

computer-readable program code that defines a set of 

appropriate key performance indicators, which can be used to 

characterize the performance of cells in terms of user 

perceived quality of service parameters; and 
25 computer-readable program code that calculates the 

above defined key performance indicators. 
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